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ABSTRACT 




This research project initially focused on identifying and synthesizing 
the, large number of previously identified vocational special needs teacher 
competencies into an educational model. The model contained a matrix that 
organized all these competencies into 12 domains of four performance phases 
each.; The Competency Matrix was the construct upon which a needs assessment 
instrument was designed. The matrix also provides direction for other 
activities in the field of vocational special needs: research, development, 
demonstration, personnel preparation, and technical assistance. 

A second project activity focused pn developing and pilot testing a 
needs assessment instrument to measure individual educators' perceived 
needs for training within each phase of the 12 domains and their preferences 
for the delivery of this training. The instrument was designed to provide 
data to assist inservice planners/deliverers in decision making efforts at. 
local, state, and/or national levels: A pilot test of the instrument was 
conducted in six Minnesota schools to determine the extent; to which the 
instrument could be shown to exhibit face, content, utility, and construct 
val idity. 

Pilot test results indicated that the instrument could give useful data 
for making inservice/preservice planning decisions and that population sub- 
groups had differing training needs. This instrument can 43rovide plannin^g 
information, but may need to be tailored to various populations' levels of 
awareness and expertise. Indications of the instrument's content, face, 
and utility validity were found, but construct validity has yet to be sub- 
stantiated. It is "recommended that further study be conducted to determine ^ 
the validity of reivised drafts of the instrument and the Competency Matrix.. 
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Chapter I 



INTRODUCTION 

Within the field of vocational education a demand has arisen for 
specialized teacher training. The purpose of this training is to enhance 
educators' abilities to facil itate, the mainstreaming of special needs stu- 
dents into regular vocational programs. National conferences have been 
conducted to focus on this concern and professional organizations have 
been established to support. mainstreaming-related efforts,,. In addition, 
numerous local, state, and national proj.ects have been created ,to initiate 
these training activities. Special needs teacher competencies are being 
identified, needs assessment instruments developed, and teacher; training 
activities planned and conducted based upon the results of competency 
Identification and needs assessment projects. Whether or not this spe- 
cialized teacher training is necessary or even makes a major contribution 
to successful mainstreaming has yet to be documented; 

There are, thought to be several key factors affecting the mainstream- 
'^Tng of special needs students.. The eventual outcome of any mainstreaming 
effort will probably be affected by factors buch as the individual student 
involved, the other students in the program, the school environment, 
the .curriculum,' the instructional materials, the .special " servi ces avail- 
able, and numerous other variables; The teacher and other educational 
personnel comprise only one of the factors in the mainstreaming process. 
Yet, educators may have a very significant impact since they have to 
orchestrate much of the educational process. ThereTore, if one is 
selecting a place to begin advancing the mainstreaming movement, identifi- 
cation and development of the required skills and knowledge of educators 
seems; a logical choice. The-need for specialized teacher training as an 
Important primary ingredient is further supported by evidence that many 
teachers have not been properly exposed to this issue in their initial 
teacher- preparation programs (Hamilton & Harrington, Note 1; Phelps, 
1976; Reynolds, 1980.)^. 

This reasoning suggests that the response of the field, that is, to 
focus on the competence of educators as a means to develop successful 
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mainstreaming programs, may be appropriate. While research is being con- ■ 
ducted to determine what factors enhance mainstreaming programs, logical 
conceptually sound efforts to better prepare educators should be under-' 
taken. This study was initiated as an effort to identi.fy the additional 
skills and knowledge needed by. vocational education teachers, coordinators, 
program supervisors/managers, and administrators in Minnesota in order, to. 
better prepare them to serve special needs students.. 

Statement of the Problem 

If specialized training is to be provided to educators to help them 
effectively teach special needs students, two questions must be answered. 
First, how is working with special needs students different fromjiiftij^ng 
with "regular" students? And, second, s'ince educators come from a variety, 
of backgrounds and experiences, how can educators be assessed to determine 
if they have the specialized skills and knowledge required to effectively 
serve special needs students? This project provides initial answers to 
these questions.- This new knowledge will provide better information with 
which to plan vocational teacher education activities focused on improved 
services for special needs students. . 
The specific study objectives were to: 
«. 1. Conduct a review and synthesis of the literature. 

2.- Develop a conceptual framework within which to consider the 

special skills ?nd knowledge require'd when teaching mainstreamed 

special needs students. ..^ 

3 Develop a process for assessing the skills and knowledge of 
educators. 

4. Pilot test the assessment process. • . • 

Definition of Terms 



A number..of key terms have been utilized throughout this report. 
Some of these terms have been used extensively in the literature but 
'without well-established, widely-accepted definitions. Also, some of the 
terms in this report were used in a specific manner to d^-fine new 



constructs. Definitions for these key terms are provided below to clarify' 
their use in this project. ' • 

Competency: The competency statements refer to those skills, understand- 
ings, and. attitudes necessary to perform an activity successfully. 

Domain: A specific area of influence or activities that is presumed to be 
important and necessary when educating special needs students. A do- 
main includes and thus classifies all related activities and compe- 
tencies with a specific focus or intended outcome. For example. Par- . 
ents is one of the 12 domains identified in this study and refens to 
the skills and knowledge which enable educators to interact with the 
parents and/or legal guardians of special, needs learners in order to 
enhance«4Lheir child's learning experiences, both at school and at home: 

Phase: -The term "phase" refers to a step in the process of providing 
services and working within a domain. These steps are: 
Assessment: The process of identifying and "measuri ng needs that 
exist within a domain related to the education of a special 
needs student. 

Planning: The process of specifying procedures and steps for meeting 

identified needs within a domain. 
Implementation: The process of providing services and activities to 

meet identified, needs within a domain.. 
Evaluation: The process of determining the adequacy, qual ity ,. and/or 
effect of the goals, objectives, inputs, procedures, and outcomes 
"of the'activities performed within a domain. 
Regular Students: The term "regular students" refers to those students ■ 
who can succeed in educational programs without additional or special 
assistance. • .. « 

Special Needs Students: The term "special needs students" refers to iFdi^ 
viduals with characteristics that prevent them from' succeeding- in - 
regular vocational education programs without additional or special 
assistance. 

Teachers/Educators: These terms will be used interchangeably in this 

report to refer to those educational personnel: teachers, coordina- 
tors, program supervisors/managers, and administrators in vocational 
and special education, who directly or indirectly serve vocational 
special needs students.. •, . * 

o •• . . 3 - 
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Chapter \V \ 

REVIEW AND SYNTHESIS OF EXISTING STUDIES AND EXPERTISE 

) The purpose of this study was to develop a process with which to 

/ assess educators' needs for special needs-related inservice training. 
This assessment was based on the broad range of current knowledge con- 
cerning special needs inservice and utilized a conceptual framework to 
identify special needs inservice variables and their interrelationships. 
Therefore, beJore work began on the development of this process, -a thorough 
review of the literature was conducted to determine which concepts and 
constructs are involved when training educators to teach special needs stu-. 
dents. A. conceptual framework was then created to depict how these con- 
cepts and constructs are related to general education models. 



Review Criteria 

The studies included in this review represent widely-accepted, and 
often-utilized studies on the topic of vocational special needs teacher 
competencies.' These studies have attempted to determine the' differences , 
in terms of teaching competencies, between^ educati ng special needs students 
and regular students. The studies were e-xamined to , determine : 

1. whdt competencies had been identified as necessary for working 
with special . needs students • . ■ 
' 2. . how.^these competencies had been categorized; 

3. what concepts were examined arrd how 'were they organized as con- 
structs for use in the studies; and 

4. how these'constructs and" competerTci e"s"^wer e val i dated . 

In order to evaluate these studies, the following considerations were 
applied: 

1. A competency identification study shoul d .incl ude a thorough, 
literature review. 



^Material in this chapter was developed concurrently with a research 
paper- Peak, L. A content analysis study of special needs teacher trcmi- 
ir^ materials usable with vocational education personnel. University ot 
Minnesota, June 1980. 



ERIC 



- 5 



2. A categorization "System based upon a classification principle 
^. should be established for the identified competencies . 

3. All components of the pategoriza^tion system^hould be represented 
i^n the list of competencies, . " ^ 

4. Face, construct, content, and predictive val idity should be estab- 
lished for the competencies. * . * . - . " 

The purpose of ttfTs""Tev1ew was to identify common elements in current 
competency studies so that a synthesis could be produced. -This synthesis 
represents, as far as the research has determined to date, the differences 
in teaching skills and knowledge required to teach special needs students 
in addition to regular sttfdents. ' 

^rior Competency Studies 

Phelps (1976), from a review of several competency identifi.cation 
studies, identified 32 tasks that teacher^ should be able to perform in 
order to teach special needs students. He hadSa panel of 32 experts . 
(taacher educators, secondary schoal personnel, local program, directors , 
and state department of education personnel) from the fields of voca- 
tional education;, special . education , and instructional development com 
plete two questionnaires to answer, "To what extent is success'ful perfor- 
mance of each, or all, of the 32 preliminary competencies critical to 
providing effective instructio^ and supportive services (to special need^ 
students)?" These experts rated the critical ity of the competencies for 
four separate groups: vocational teachers, spe*cia^l' education teachers 
and/or consultants, counselors, and cooperative or -work experience coordi- 
nators. Also, teachers and teacher coordinators from comprehensive high 
schools, middle schools or junior- high schools, and area vocationa-l centers 
were asked to indicate on a needs, assessment instrument the rel at'ive • amount 
of time they spent using these i,nstructional practices (competencies) with, 
special needs learners. As a' result, of these questionnaires and 'the needs . 
assessment, it was determined that all of the 32 teacher tasks or competen- 
' cies were critical to dealing with special needs students successfully. 
The following list identifies the categories into which Phelps grouped the 
32 competencies and the titles of teacher training modules he developed: 
Learner Identification and Anal ysi s Cooperative instructional Arrange- 
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ments, InstructioriaJ— ft«-ertrrces , CI uster and Contenf Analysis, Instructi9nal 
Planning, Instructional Implementation, and Evaluation of Learner Progress. 

Albright et al . (1975) utilized two consultant committees to identify 
competencies necessary for vocational education teachers to successfully 
teachn special needs students. *The first committee consisted .of 15 teachers 
representing the programs that were currently serving the majonity cf 
Ohia's disadvantagad and handicapped youth: OOiCupational Work Experience" 
(OWE), Occupational Work Adjustment ^TOWA) , and. Special Needs Program . The 
second committee consisted ofv stx state staff members representing Ohio's 
OWEi, OWA, and Special Needs p'rogram. Through a series of meetings, the 
fir'st committee bra ins tormea^aYid^idei>tdTi competencies necessary for 
effective performance in. the folljM^^ing specific instructional areas: -pro--, 
"gralm management; remedi^al math; remedial reading; home, school, and work 
coordination; counseling; curriculum; and' classroom management . The second 
comrpittee revi ewed'^^this list of competencies, made suggestions for changes, 
and developed a survey questionnaire to be distributed to local teachers 
and supervisors. The two committees produced a list of 112 competencies 
that were grouped into- the following categories: Program Management, Cur- 
riculum, CI assroom Management , Coordination, Remediation, and Counseling. 

The survey questionnaire was distributed to all of Ohio's OWA, Olj[E, 
and Special Needs Teachers and Supervisors. The questionnaire requested* 
that each respondent rate eaqh of the. 112 competencies accoi/ding to: (1) 



^ their need for the competency 



and (2) how frequently trh^y used the coin 



petency. The report states ^that both the teacher a'^nd the supervisor '. 
respo.H^s (a total of 718 qL^estionnaires was returned) to the survey in- 
dicated that all 112 competencies were perceived as necessary and valid. 

A state-wide Special Vocational Needs Endorsement Committee in Neb- 
raska developed the followir^g seven major headings for special needs 
teacher competencies : Progra^ Planning,^urriculjjm/ Development, Method 
of Instruction, Evaluation, Guidance, Human Relations, and. Management' of 
■Learning and Behavior. Then fleers (no date) developed a list of 102 com- 
petencies which were distributed among these headings. This competency 
list was designed ''by Meers to act as a guide for state-wide teacher 
training prpgrams^^ i 

Marc Hull and William Halloran (1974) developed an Essential Teaching 
Competencies list of 200 competencies to be used in the preservice and in- 
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se>"v.ice training of teachers, in vocational and practical arts education - 
for the handicapped. This list was created by the project's staff based 
upon the studies of Brol in (1970), Batman (1969), Cotrell ■ (1 971 ) , Kruppa 
(1573), and others. on special -needs teacher competencies. This list of 
.Essential Teaching Competencies" was grouped into the following competency 
areas: Designing Instruction, Direct Purposeful Instruction, Developing 
Instructional Materials, Evaluating Instruction, Providing Student Guid- 
ance, Conducting Research, Managing the Classroom, Commitment to Educa-- 
tionai Profession, and Maintaining Community Relations. 

Shepp^rd (1975) conducted a survey study to identify competencies, 
problems, and necessary resources 'vocational /technical education personnel 
perceived as being critical in working with disadvantaged and/or handi- 
capped students. The survey questionnaire was administered during a 
graduate course to 108 vocational education personnel who were selected 
for' participation as a result of being chosen as EPDA (the Educational 
Pro'fessional Devel^opment Act) scholarship awardees. The questionnaire 
asked respondents to rank order a list of programs and/or experiences 
' according to' which ones they felt had best prepared them for working with 
the disadvantaged and/or handicapped. The respondents were also asked to 
indicate, "What teaching techniques,- resource persons, and/or curriculum 
materials have you found in general to be most helpful in working with -the 
disadva-ntaged- or handicapped youth?" and, also, the greatest problems they 
encountered when working with these students. Then- the ro'-. pondents were 
asked to rate 16 competencies a(;cording to their importance to the respond- 
ent in perfor-^ing his/her job. The report states that from the list of 16 
special needs tea^cher competencies created by the project, staff, the ma^cr- 
ity of the respondents rated 13 of the competencies as very important and 
3 as important to' performing successfully in their position. 

Phelr,s et al . (1976) reported upon a National Teacher Education>Iork- 
,shop wiere ten experienced and knowledgeable teams of university and state 
department vocational and special education teacher educators' gathered to., 
■ among other activities, ".identify a series of professional tasks needing 
to be performed by personnel involved in the vocational programming, of 
special needs students."; While attending the workshop, the partic-ipants 
completed a q-j-istionnaire. where they rated each of 49 profess'-onal tasks 
on: "(1) What is the relative amount of time you would be likely to s.pend 
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cond udrl ng-t h i-s-t-a-s k^?-,-.(.20-Ho W-xrjJ:ic_aJ.._ wguld_^u perf orma n c e o f 
this task be to the overall effectiveness of your program?, and (3) As a 
local .educator working with special needs students , to what extent would 
you need to know more about this task?"_ The. participants were asked to 
answer each af the questions. from. a local educator! s ^oint^of^iew (voca- 
tional teacher, special education teacher, or counselor). 

The list of 49 professional taskswas assimil ated by^the workshop 
staff following a review of several competency identification studies from 
the fields of vocational and special education (Albright et al . , 1975; 
Cotrell et al . , 1970; Kruppa et al . ,^ 1973; Schoonmaker & Girard, 1975; 
Brock, 1975; and Phelps, 1976,' were the main resources) .\The statements 
were designed to identify the critical components needed i ft, effective voca- 
tional special needs programming. The tasks were classified '^somewhat 
arbitrarily" into four major function categories: Assessing Program and 
Learner Needs, Planning Instruction, Implementing Instruction, and Evalu- 
ating Program and Instruction. As a pilot test of the tasks and the ques- 
tionnaire, the Professfonal Task, .Analysis Questionnaire was al sQ: .distrib- 
uted to 26 secondary-level vocational and special education teathers and 
administrators in Illinois. 

As a group, the' teacher educators felt all of the tasks except one 
were at. least "important." The local school personnel rated more than 
half ofxthe tasks (28) below the important level on the critical ity scale. 
Both'^of these populations had general agreement on the various tasks in 
which they felt they needed more training. 'Nb data were reported on the 
: question of'itime. sp,ent oji conducting the, tasks. . . 

Andreyka" et al . (1976) i dent i_fi ed ^90 .pmf essi o_nal^ compet enci es , iir- 
•portant tq' vocational, teachers, administrators, and supervisors servin.j: 
-'haridicapp^cl ^students, to use in' the .development of a|.'exemplary;.competency- 
based voc'ational .teacher :educatiQn-and--l-'eadershi p development program in 
Florida. This list of competencies was -initially developed and categorized 
by a team of three persons sel ected by the Florida, ^^t ate University Voca- 
tional Education Department, following a review of "the literature and 
personal interviews of TalTa.hassee-area teachers of the handicapped. 
The preliminary competency ,1 i st was. then reviewed and revised by a jury of 
five educators, (a consultant to handicapped and work study programs, a 
special education director , two"%el ementary teachers , and. an associate 
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professor in industrial arts). The jury developed a survey instrument 
whi c h -a s k e d-r e s po n d e nt s-t o _ ra t.e .e a c h . o f Jt h e 90 _ com^e te^cj es^o n^^ po r - 
tance scale of 1 = very important to 6 = not . important to their position. 
The survey was mailed, to a sample of 165 persons including 22 county voca- 
tional dir^ctorsr 22 county level administrators, 80 vocational teachers, 
and 41 participants of a workshop entitled Industrial Arts for Exceptional 
Youth. A total of 86 instruments was returned. It was found that of the 
90. competency statements, only three had an average importance rating 
higher than the midpoint (3.5) on the 6-point scale. 

Yung et al . (1978) conducted a needs assessment of vocational teachers 
-of special needs students to determine what competencies should be included 
^in preservice and inservice teacher education programs for this population 
in Arkansas. The competencies included in the needs assessment instrument 
'were first identified by project staff through a review of ten special 
needs teacher competency studies and from suggestions of vocational special 
needs education experts in Pennsylvania and Arkansas. Forty-three tasks 
were selected from this information as being the most important tasks of 
vocational special needs education teachers. Several experts (faculty 
members and research assistants in the Division of Occupational and Voca- 
tional Teacher Education at the University of Arkansas, and Arkansas State 
Department Personnel) were selected to review these 43 tasks: Suggestions 
for adding, deleting, or reworking the competencies were made by the ex- 
perts and resulted in the final list of 42 competencies to be used in the 
needs assessment questionnaires. 

.Two needs assessment questionnaires were developed. One questionnaire 
asked school superintendents to rate the importance of the 42 competencies 
using a 5-point scale (1 = unimportant to 5 = extremely important), 'and - 
then to indicate on another 5-po1nt scale (1= unconfident to 5 - extremely 
•confident) "how confident their teachers were in performing each task." 
The second questionnaire asked teachers to rate the 42 competencies on the 
same two scales but to do so in terms of nmpbrtance to them and their per- 
sonal confidence. The questionnaires were pilot tested with 59 students 
a^ttending classes in the Department of Vocational Teacher Education. An 
item analysis was conducted on the responses of. the importance rating sec- 
tion. The report states that the coefficient alpha index rel iabil i ty was 
0.958, and the item total correlation coefficient ranged from 0.375 to , 
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0.772. The report goes on to state that these results indicated that the 
scale was internally consistent and each item was contributing consistently 

to the total score. ~ 

Packages of questionnaires, one questionnaire for the superintendent 
and the others for the vocational and special education personnel, were 
sent to 45 school districts in Arkansas. A total of 29 superintendents- 
and 317 special, needs education personnel in 35 school districts responded 
to tlie s t udy . In - 1 h e re su 1 1 s , 24 out of 42 ta s k s had^mean 'i mportari ce 
scores of 4.00 or above and only three tasks had mean scores of 3.70 or 
less as rated by s.uperintendents and teachers as a group. The teachers' 
confidence scores on the 42 tasks ranged from 2.85 to 3.83. 

Schoonmaker and Girard (1975) identified competencies for habilitation 
personnel, particularly public school secondary-level special education 
personnel . Rather than using the popular, "role-analysis" method of identi- 
fying competencies, they analyzed the basic functions or processes used by 
habilitation personnel in different roles in providing their services to 
. students. This functional analysis indicated that the following five ' :; ; 
steps are found in some form in virtually all habilitation roles: select 
target population, define need, specify implementation plan, implement 
plan, and evaluate effects. Although there are significant differences 
between habilitation roles, these differences arc primarily a matter of 
applying the same habilitation process but to different types of needs in 
different target populations. Schoonmaker , and Girard used a'lattice sys- 
'tems analysis approach to identify the competencies that would be required 
of habilitation personnel in performing each of these five steps. The al- 
most innumerable number of competencies that were contained in each of 
these steps were then used as the basis for the development of 29 instruc- 
tional modules for habil itation personnel . 

Kruppa et al . (1973) reviewed the competency lists from the studies 
of Brolin and Thomas (1972), Melby and Regal (1972), and Cotrell et al . 
(1970),. and used-these lists as the primary sources in the development of 
-a Tist of 330 competency statements needed by individuals preparing to 
become mainstream or special industrial education teachers. A jury of ex- 
perls (faculty members from the departments of industrial and special edu- 
cation at Trenton State College) evaluated this list of .competencies and 
then_cl a ssi f i ed them into t h e f o 1 1 o wi n g ca t e go r i e s : Pro gram De v el o pm en t . 



Instruction, Knowledge of Learner, Community Resources, Professional Role 
and Development, Management, Personality, and Guidance. 

, J p.. a - f-inal pro-j e c t-r e po r-t-d e.s c.r_i bi ng a n e i g h t -year project that began 

. in 1970 and included the teacher competency identification work and publi- 
cations of Brolin (1970), Brolin and Thomas (1972), Brolin (1973), and 
Brock (1975) — Robert Brock (1978) presented the activities that eventu- 
ally led to the identification of 18 competencies to be used as the basis 

^ -far-aniew-teacher training program at the University of W.i scons in-Stput. 

In 1970, a Curriculum Planning Conference was, held af the University of 
Wisconsin-Stout to determine the needs of EMR students and formulate teach- 
ing competencies based upon. the special needs of secondary (ages 12-21) 
special education students. Many' national -1 eaders (including Charles 
Kokaska, James Bitter,. Rex Priegar, Jack Dinger, Gary Clark, and Marc 
Gold) along wUh 30 professional and lay people representing parent groups, 
employment agencies, training schools, public schools, vocational schools, 
vocational rehabilitation agencies, universities, work experience program 
coordinators, community service centers, state department of public in- 
struction, cooperative educational service agencies, and others helped 
develop the primary need and competency statements. These participants 
identified 90 secondary EMR student needs and 113 teacher competencies. 
This list of 203 was then reduced to a list of 31 competencies through the 
Delphi technique'.- 

- The 31 competencies were divided into four curriculum area^occu^- 
tidnal information and preparation, curri^'ul urn area, activities of daily 
living curriculum area, psycho-so.e}ial curriculum area, and academic cur- 
riculum area. Pro ject " staff then' developed a questionnaire upon which 
■ respondents would rate each of the 31 competency statements according to 
the.(l) importance (1 =. not important to 5 = very important) of the com- 
petency in the EMR curriculum, (2.) who they felt should ideally perform 
the competency, and (3) who in practice currently performed the competency 
The questionnaire also ask indicate the percentage of 
' emphasis they felt should be spent in each of the four curriculum areas 
during the overall three-year high school program. This questionnaire 
was mailed to all 251 secondary EMR teachers and 31 randomly selected 
supervisors in the state. Of the 282 questionnaires mailed, 205 {12%) 
wprp returned . The re sults indicated that the respondents perceived the 

-12- i^' 

O ■ 

ERIC 



curriculum area of occupational information and preparation to be of • 
crucial importance to the secondary EMR student. Only one of the 31 com- 
petencies received a total group mean "importance" rating of less than 3.50 

(thP mP3n rating was 3.45 ).' Twentv-three of the co mpet encies receiv ed a 

mean "importance" rating of 4.00 or above, and seven competencies had mean 
"importance" ratings from 3.84 to 3.98. Based upon these findings, the 
project staff proceeded to develop a model program for secondary EMR stu- 
dents and a teacher training model directed to the needs of students. 

In 1972,...the__proj.ecOtMf__detejr^min^^^ 31 previously identi- 

fied and validated competencies "were not instructional competencies; in 
fact, they were not competencies at all... they represented vague generali- 
ties difficult to translate into educational , outcomes . " Therefore, they 
decided to develop a new set of teacher competencies. With the help of 
several additional experts (including Richard Brady and M. Steven . Lil 1 y) 
and field-based instructors, the project staff defined specific competen- • 
cies needed by the vocational -educator of the handicapped. An analysis of 
the project's previously developed "description (role definition) of the 
idealized vocational educator for the handicapped," yielded a list of 18 
competencies necessary for the vocational educator of the handicapped to 
function effectively in the. secondary school setting. This new list of 18 
competencies then became the basis of the project's teacher training 
model . . " 

Goldhammer' et al . (1977) compiled a 1 isting_of mainstreaming teacher 
competencies -from. 1 ists of competencies that had been previously identi- 
fied by fourteen Deans' Projects^ at the following Institutions: Univer- 
sity of Alabama, University of Alabama-Birmingham, California State Uni- 
versity-San Francisco, Univey>sity of Colorado, Edinboro State College, 
University of Hawai i-Manoa , University of Kansas, Michigan State Univer- 
sity, University of tlinnesota. University of Missouri -Col umbia , University 
of North Carolina, the Pennsylvania State University, Tennessee State 
University, and Wichita State University. This compilation contains 454 
general teacher competencies needed by all teachers working in mainstream- 

^Deans' Grant Projects, supported by the Bureau of Education for the 
Handicapped (now the Office of Special Education and Rehabilitative Serv- 
ices), are projects run through colleges of education to infuse training 
for mainstreaming. into current preservice teacher training curricula. 
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ing classrooms in the public schools. As the competencies from the vari- 
ous Deans* Projects were reviewed and the complete list compiled, the com- 
petencies were grouped into 13 categories. These categories were identi- 

fie d by grouping the competencies according to similarities: Nature of 

Mainstreaming, Nature of the Handicapped., Attitudes, Resources, Teachi4ig 
Techniques, Learni^ng Environments, Learning Styles, Classroom Management, 
Curriculum, Communication, Assessing Student ' Needs , Evaluating Student 
Progress, and Administration. 

Fowler (1978) identified 58 teacher competencies through a "needs sur- 
vey '"^o f Co 1 or ado' s s e cb n~d a ry "t e a c hers a hd . p r o's p e c t ive secondary teachers. 
The competencies were identified as "being essential areas "for providing 
appropriate background necessary for general secondary teachers to work 
with handicapped students .i n-r^^gufar secondary, classes ." These teacher 
competencies were grouped into the^ following/units for incorporation into 
a teacher inservice/preservice special needs training guide: )^n Overview 
of Handicapping Conditions; Mainstreaming Legislation, and Teacher Respon- 
sibilities; Assessing Secondary Student Needs; Planning and Providing for 
Individual Differences at the Secondary Level; Promoting Appropriate Stu- 
dent Behaviors; Secondary Teachers 'i Role and Involvement with Parents; 
Secondary Subject Area Instructional Modifications and Adaptations; and 
Preparing Students for Mainstreaming. '. The guide was designed for college 
faculty or inservice instructors to Use in courses or workshops. 

Hamilton and Harrington ..(Note li. conducted a review and synthesis of 
special needs-related teacher competencies that had been identified 
through previous studies. The intended outcome, of this activity was to 
;be the development of performance-based teacher education modules to train 
vocational educators in "nondiscriminating practices." The studies that 
were reviewed were identified through computer searches of the Educational 
Resources Information Center (ERIC) and Council for Exceptional Children 
data bases . - . > - . 

After reviewing and synthesizing more than 20 studies in the teacher 
competency' 1 iterature, several problems were identified regarding the cur- 
rent state-of-the-art iri teacher competency identi'fication. The authors 
found that the competencies in the literature: (a) did not encompass 
those needed to serve all of the special needs groups who are being 
enrolled in regular vocational classes; (b) often lacked the specificity 



needed to give direction to teacher trainers; and (c) had "a high level of 
duplication .of competencies across the various competency listings, re- 
gardless of which special population was being addressed. Based upon 
these observations, the iDroject staff felt it was necessary to go beyond 

"the— efforts "ma-dG--in-the"Studi-es-ndentifi.ed-in--the-Ti^^ 
identify competencies for their training modules. 

The project utilized the DACUM (IDeveloping A. C_urriculum) process to 
identify 384 competencies . This process was described as-'a modified 
brainstorming process using small groups of expert practitioners to analyze 
an occupational area and reach consensus on the skills needed, A DACUM 
panel was formed for each of eight special needs groups that had beeii 

^identified by the project staff. The panels were to analyze the role'of 
the teacher in serving the special needs group the panel represented. 
After all eight DACUM panels had met, the staff analyzed all eight lists 
to identify -broad competency areas. The report states that each group 
produced, essentially, the same broad competency areas. The competencies 
from each of the eight lists were combined into the appropriate competency, 
areas and these lists were analyzed to screen out overlap and repetition 
in competency statements. This resulted in a single list of competencies 

. needed by vot^ational teachers working with students with sp^ial needs. 
This list was compared to 25 other existing lists from the literature re- 
view to determine if any critical competencies had been overlooked. 
These 384 competencies were further tested using a questionnaire with 80 
persons who had expertise in the eight special needs groups. These people 
were asked to, rate each competency according to its importance to the voca- 
tional teacher of the special needs group-they represented. These people 
also ranked the importance of the 15 broad competency areas. The fifteen 
areas, as listed below, are being used as the topics for the development 
of the training modules: Instructional Planning; Preparation of Students 
for Employabil ity; Materials Selection/Development; Special Instructional 
Techniques;. Counseling/Student Sel f-:Awareness , Self-Concept, Self-image, 
Self-Actualization; Identification/Diagnosis of Students; Communication/ 
Language/Vocabulary; Development of Students' Career Planning Skills; 
Student Evaluation; Program Evaluation; Professional Development; Develop- 
ment of Students' Life-RoTe Competencies; Modification of Learning Envi- 
ronment/Physical Setting; Promotion of Peer Acceptance; and Program Promo- 



. Literature Summary and Conclusions 

From this literature review, it is evident that there are large varia- 
tions among the special needs educator competencies that have thus far been 
TdentiTi^^ Th¥TumbeF"crf~Z6mpeterTc1 es va'ri"ed~f ronr"15~t"cr"384"; Some of "the" 
differences in the number of competencies identified is obviously due to 
the level of specificity with which the competenci es were stated or the 
manner in which they were" defirfedr^rHamil to Harrington (Note 1) found 

through their l iterature, review and synthesis that ".. .the level of compe- 
tency speciftcity varies widely as the the number of competency statements 
identified" (p. 5). - There also is disagreement between studies on whether 

•a 

some specific competencies should be taught. 

Details of studies' competency identification and validation procedures 
were provided in the literature review. No one study stands out as more 
valid than the others. Competencies were generally identified by analyzing 
the role of a teacher working with special needs studecits. Only one study 
identified competencies by analyzing the process of serving students with 
special needs. The five techniques that were reportedly used to develop 
compet^ency lists are as. fol 1 ows : 

•> 1. Compile lists of competencies from other studies. 

2. Ask practicing educators to identify competencies. 

3.. Ask "experts" to identify competencies. . 

4. Conduct a systems analysis to identify competencies. 

5. Conduct a needs survey to identify competencies. 

The first three techniques were the most often used, the last two were, each 
used in only one of the studies examined. When experts, were used, no "ex- 
pertise" criteria were reported . for the expert selection process. Various 
methods were used to validate the competencies identified in these studies. 
These validation techniques are listed below: 

1. Teachers rated the importance of each competency. 

2. Administrators rated the importance of each competency. 

3. Experts rated the importance of each competency, / 

4. Teachers indicated how much time. they spend performing each 

competency. - \, 

5. . Administrators indicated how much time they spend performing each 

competency. 
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>6.' .Experts indicated how much time educators- spend performing each 
competency. 

. These identification, and validation techniques provide indications of 
.face validity for the competencies. In those studies that rated the compe- 

^tertc-i-es-for— import-anee-r 1 imited cont-ent-val4d-ity may-al-so-have-been-e-stab- 

' lished; None of the identified studies addressed the construct or predic- 
tive validity of the competencies. Only one study reported that the relia- 
" " bility of the instrument used to val i date the competencies had been examined 
Also, "none of the studies attempted to establish the„ validity of the con- 
structs presented as means of classifying the competencies into vacious 
categories. The "sets of categories identified were not derived from -a clas- 
sification principle.^ Within a set of categories, some of the categories 
would, represent exhaustive areas of working with special needs students 
while other categories would represent the process (phases) of working with- 
in these areas . 

Of the "cbmpetency. 1 i sts ;tbat were • revi ewed , no list included all the 
compotencies or concepts identified in the other studies; yet, there was 
much duplication among the 1 ists. The one common characteristic was that 
most of the studies grouped competencies into similar categories. However, 
' none of the studies created a model for organizing the universe of skills 
and knowledge in the special needs educator competencie.s . ^ What exists in 
the literature is not well validated but seems to represent the best think- 
ing of those professionals who have worked in this problem area. The 
approach taken in this study was to extract common elements from the litera 
ture and define, through a classification system or matrix, the domains and 
phases of competencies for working with special needs students. This syn- 
thesis of the literature is, therefore, assumed to represent "the state-of- 
the-art of educating vocational special needs students as ..descri bed by the 
current literature. 

A Synthesis of the Literature 




The purpose^of the compilation and synthesis of the competency state- 
ments and concepts >dentified through the literature review was to develop 
a classification syste^iNvor the special needs educator competencies. If 
a conceptually sound set of^cpmpetency domains could be established for 



all skills and knowledge required to serve special needs students, then 
those constructs would delineate the areas for preparing educators to 
work with special needs students. The following steps outline. the proce- 
dure used to create a matrix- of competency. domains and phases. 



Procedures 

All of the special needs educator competencies identified in the lit- 
,erature review were compiled into a 50 page master list. An advisory com- 
mittee of, 12 educators {see Appendix A for the list of committee members) 
'was organized to review th% master list to minimize the possibility that 
competencies had been overlooked. -Each member of the advisory committee 
was asked to read through the master list of speci al . need.s educator compe- 
tencies and perform the following three activities: 

1. List any special needs educator competencies which they felt had 
been excluded from the master list. 

2. Identify any competencies thought to be inappropriate. 

3. Note any related competency studies or prior research efforts, 
not included in the lift of references, that might further en- 
hance the master list. "~ ^ 

The input from the advisory committee (6 out of 12 advisory committee mem- 
bers responded) resulted in no additions to, or deletions from, the master 

1 ist. ^ , 

The master list was then analyzed to determine whether certain cate- 
gories or domains of competencies were evident. After a thorough analysis, 
12 distinct and exhaustive domains whose focuses are mutually exclusive were 
identified within the master list. This analysis "was conducted by identi- 
fying the concepts- and skills being presented in each of the competencies 
and" then grouping the competencies according to similarity of focus or_ 
intended outcome. ' These domains were compared and contrasted with the 
categories and domains that had been identified i.n the studies in the 
literature review. The 12 domains were found to include all categories 
found in the literature: The -appropri ateness of the categories represented 
by the 12 domains was examined by again analyzing each competency ^.catement 
in the master list to determine if the competency logically fit int, one 
of the 12 domains and which one. 

As the competencies from the master list were grouped in the domains. 



It became apparent that there were specific performance phases within each 
of these domains. The competencies in each of the domains outlined a se- 
quence or steps required to function successfully in that domain. The 
steps de^scribed by the competencies were: assessing the needs within'the 
.domain, planning activities to meet those needs, imp! ementi ng" the activi- 
ties, and evaluation of the~adequacy aTid "effecT of "the~acti"vi-ttes-r 



i^hoonmaker and Girard (1975, pp. 9-11) made a similar observation when 
the)^were .identifying competencies for habilitation personnel. They found 
that all habilitation personnel, regardless of their role, perform the same 
sequence of steps in providing their services: "...(1) select target popu- 
lation, (2) define need, (3) specify implementation plan, (4) implement 
plan, and (5) evaluate effects." 

After analyzing the contents of the master list, the Special Needs 
Teacher Competency Matrix (see Figure 1) was developed. Each of the com- 
petencies in the master list were placed in the most appropriate matrix 
cell. Thus, the matrix represents a classification system believed to en- 
compass all compe'tencies related to educating special needs students. 

3 

The Special Needs Conceptual Framework ■ 

The Conceptual Framework is presented at this point to explain how 
the Special Needs Teacher Competency Matrix provides a conceptually sound 
system for classifying the unique activities involved when educating spe- 
cial needs students. Since the relationship between the matrix and general 
education concepts has been demonstrated by this framework (see Figure 3), 
this relationship enhance? the matrix's construct and content validity 
and justifi.es use of the matrix as a mechanism for determining^ the training 
required by educators in order to work effectively with special needs stu- 

CI . . 

dents . 

The Framework can best be understood if a model of an educational 
concept/process is considered first. Cronbach and Gleser (1965) and 
Cronbach and Snow (1977) defined and documented the education concept/ 
process of Aptitude-Treatment Interaction (ATI)^, also referred to as 



^Material in this section also reflects work done by:\ Russd, R.P. 
Toward understanding and evaluating special needs programs. •Minneapolis 
University of Minnesota, Minnesota Research and Development Center, 1980 



PHASES 



DOMAINS' 



1. Educational Needs of the Student 

2. Personal Needs of the Student- 
s' Classroom Social .Environment 
4. Classroom Physical Environment 

5\ The^ Individualized Education Plan 

6. Course Curriculum* 

7. Instructional Materials 

8. Special Needs Support Services 
^9. Parents 

10. Community Resources 

11. Legislation and Funding 



12. Continuing Professional Development 
of the Teacher ^. . C^ 



£= 

0) 

E 
c/) 
</) 
CU 
CO 

to 



c 

C 
Cu 



o 



'CU 
CU 



O 



<T3 



Figure l ". The Special Needs Teacher -Competency Matrix 
^ Domain titles are referred to in later tables by number only. 
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Trait-Treatment Interaction (TTI) by other educators. ATI represents 
■ how the process of education results from, and is influenced by, the 

interaction of two factors. These factors are the aptitudes or charac-. 
- teristics of an individual and treatment(s) i^or those aptitudes. , 

The "aptitudes" of a student are defined as "any characteristics of a 
person that forecasts h-fes probability of success under a given treatment" 
(Cronbach & Snow, 1977, p. 6). Cronbach and Snow. also stated that person- 
ality as v^ell as ability and other variables such as social class, ethnic 
background, educational "history, etc., all can serve as characteristics . 
that "may influence the *1 earner ' s response to a treatment. The term "treat 
ment" also has a broad meaning: "...it covers any manipulable variable," 
.such uS classroom environment, teacher characteristics', arid the pace, 
method, or styl e of Jjistructi on (Cronbach & Snow, 1977, p. 6)/ To 
quote Cronbach and Snow (1977): 

Aptitude-Treatment interactions exist. To assert the opposite 
is to assert that whichever educational procedure is best for 
Johnnfy is best for everyone else in Johnny's school. Even the 
most • commonpl ace adaptation of .instruction , such a^ choosing 
different books for more and 1 ess capable read^ers of a given 
age, rests on an assumption of ATI that it seems~ fool-i sh to 
• challenge, (p. 492) • . 

A variation in either the aptitude or treatments may change the type 
of interaction that results. There are many possible variables in the 
aptitudes^of students and numerous possible treatments. ' As one approach 
to the categorization., of thes.e' variables, Stufflebeam, Foley, Gephart, 
• Cuba, Hammond, Merriman and Prov'iis (1971, p. 125) have classified- the in- 
'l .puts to an e<^jcatTo¥al~system into-six- categorie^^ pupil s staff , com- 
munity, curriculum, finance,, and facility. These categories~organize and 
classify the input variables to the ATI, 'as presented in Figure 2. Thus, 
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Figure 2. The Eclucatiori Model 
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the variables in the interaction process can come from six different 
inputs: the pupil ' s inherent capabilities determine the aptitudes-, and 
the other inputs determine the availability of • treatments . ^ . 

^ /in the event that the pupil has special . educational nee^^ these six 
inputs may change somewhat. Some variables within each input area receive 
more emphasis than others; also, cfdditional variables may be added. This 
may result from requirements in the special needs legislation, or- because 
•of certain student disabilities. These, vari abl es and emphases are contained 

Hi ■ 

within. 12 distinct domains of working with special needs students. The re-^ 
lationship between ATI and the special needs competency domains is displayed 
as the" Special Needs Conceptual Framework (see Figure 3). 

The Conceptual Framework i'S useful when examining all activities in , 
the field of vocational special needs: research, devel opment ,. demonstra- 
tion, personnel preparation, and technical assistance. The Framework, al- 
though still in the development stage, potentially may provide a standard 
by which to organize, plan, and evaluate activities in the field of voca- - 
tional education as they focus on educating special needs students, as well 
as. those normal ly served ... Future research efforts will, hopefu;ily, focus 
on more thorough examinations, testing, and refinement of the Conceptual 
Framework. Only through such efforts will the Framework's applications 
and implications be adequately understood. 
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Figure 3, The Special Needs Conceptual Framework. 



Chapter III 

METHODOLOGY AND RESULTS 

Two of this study's objectives have now been explored and discussed: 
(a) a review of the literature which identified educator competencies 
believed to be essential to the effective education of special needs 
students and (b) the organization of those competencies into the -Conceptual 
Framework. The next phase of this report focuses on the remaining project, 
objectives: (c) the development of a process for ass,essing the special 

needs-related skills and knowledge of educators and (d) the pi.lot testing 

■ " ' - ■ ■ ■•■ . ■ ■■ ' 

of that assessment process. 

After the Competency Matrix reached a level of development- at which 
it was believed to reflect the wide range of competencies, in the literature, 
the Conceptual Framework was developed based upon that Matrix and became 
a standard which-could be used to guide the development of a broad range of 
'special needs-related activities. The needs assessment instrument 
developed during this study contains items related to each competency area 
contained in the Conceptual Framework. 

The eventual result of this research will be a valid and reliable 
needs assessment process.- However, the. immediate goal of this pilot test 
phase of the project was to develop a questionnaire for the assessment . 
process and to examine the questionnaires' v-^^lidity. The literature 
revealed that no assessment instruments with adequate evidence of their 
validity exist. Therefore, it was deemed important that this instrument 
be' examined for content, face, construct, and utility validity in order to 
avoid. the validity related 1 imitations ..of existing instruments. Based upon 
the results of this study, the instrument will be revised and then investi- 
gated to determine its reliability and predictive validity. 

The initial pilot test instrument was designed to assist planners of 
special needs-related inservice training programs. The- instrument is 
intended to be of value to local, state and national educational personnel 
in their efforts to determine n"nservice needs among teachers-, administra- 
tors, coordinators, and other support service personnel . The assessment 
process is designed to provide information about areas in which these 
professionals believe they have training needs and will identify the . 
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types of training programs^ which they feel are worthwhile, appropriate, and 
desirable. With this general information, inservice ,p1 anners can then iden- 
tify the specific skill's and knowledge that they feel need to be presented 
as inservice activities for the population surveyed. 

Instrumentation 

The pilot test instrument was constructed to test the feasibility of 
determining educator training needs in each of the domains and phases of 
the Teacher Competency Matrix. The results of the pilot .test will be used 
to guide revisions, and additional field testing and development of the in- 
strument. 

The instrument was divided into three parts. Part I collected 
specific information about each respondent ' s educational background,, qual i- 
fications, and experiences. Part II examined respondents' inservice \ 
trainiWg-vtieeds and Part III explored respondents' preferences for receiving 
this training (see Appendix B for a copy of the instrument). 

Part I of the pilot test instrument collected biographical background 
information from each respondent. These data were used in the one way. 
analysis of variance, with the data from Part II of the instrument, to 
analyze the instrument's val.idity and to determine characteristics of the 

respondent population. 

Part II oV the pilot test instrument allowed, respondents to examine 
- their perceptions -of their training needs in each phase of the 12 domains. 
This informatiq^n was used as an indication of respondents' need for in- 
service training. The instrument contained a description of the 12 domains 
and the four phases, in those domains. Respondents were asked to read the 
domain descriptions and to select- the number on the Ukert Scale that best 
indicated the amount of additional .training they needed to effectively 
work with speci'al needs students. Each respondent circled one response 
•for each'phase bf each domain as shown in the example in Figure 4. . 
Limitations of time and cost precluded methods which would have measured 
-respondents' ..actual social needs-related abilities instead of their self- 
perceptions of those abilities. 

To determine respondents' preferences for receiving this training. 
Part III of theiinstrument asked respondents to select and rank their . 
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Your need for training 

Domain: Cont44iu-i-ng-pr-o^-e-s*44f«'l ' No . Mod- 

. development of the teacher need erate ^ 

Those "procedures (formal and in- Phase:, Assessment '* A ^-^ ® ^ 

formal) by which an. educator con- Planning * (1) 2 3 4 5^ 

tinues to seek to improve his/her Implementation * 1 2 3 4 (5) 

ability to educate all students Evaluation (*) 12 3 4 5 

Figure 4. Example of possible responses on the needs assessment instrument 

three most preferred choices from lists of possible alternatives. This 
part contained three questions which examined how respondents would like to 
receive, the training, when they would prefer to receive the training, and 
from whom (see Appendix B).' 

An addendum, the Comments Page, was attached to the back of the instru-- 
ment to assist in meeting the pilot test objectives. The Comments Page 
consisted- o"f a set of open-ended questions soliciting respondents' comments 
on the format of the instrument and whether they felt this was a good way 
to assess their training needs for serving special needs- students (this 
Comments Page is included, in Appendix B). . 

Procedures 

Sampi e 

A sample of three secondary and three postsecondary vocational schools 
in Minnesota was selected for pilot testing the instrument. Approximately 
20 vocational teachers were randomly selected from each school. There were 
a total of 110 participating teachers. The. distribution of the 110 
participants by their school affiliation and sex is -shown in Table 1. 

The institutions were representative of each of the types of public 
school vocational education programs in Minnesota. The secondary level 
group contained a comprehensive vocational program, a vocational center 
that is affiliated with a postsecondary Area Vocational -Technical'?Institute 
(AVTI), and a vocational center that is not affiliated with an AVTI . The 
postsecondary level group contained a metropolitan AVTI with an establ i sh_ed._ 
vocational special needs program, a metropolitan AVTI with a developing 
special needs program, and an AVTI in a non-metropolitan region of Minnesota. 



Table 1 

Sample Population: Sex and Institutional AffiLiationv 
• Type of vocational program 



Secondary ' >. Postsecondary 



cp„ - Compre- 
hensive 


No n- AVTI 
aTfil iated 
center 


AVTI 
affiliated 
center 


Out- 
state 
AVTI 


Estab-^' 
1 ished 
AVTI 


ging 

AVTI 


Totals 


Male 15 
Femal e 6 


5 
4 


11 

■ 9 ■ • 


• 17 
3 


12 
8 


14 
6 


74 
36 


TOTALS 21 


9 


20 


20 


20 


20 


110 


^An AVTI with an 


establ ished. 


well respected commitment to 


serving 


special 



needs students.' • ~ 

b^n AVTI with a recently developed, still emerging commitment to serving 
special needs students. • 

Data Collection ^ 

Administrators at each of the six schools were contacted and requested 

. to encourage the pilot test participants to complete and return the forth- 
comi.ng questionnaires.. Each member of the sample population was mailed a 
copy of the instrument and a Comments Page to complete. • A cover letter 
asked that the comjileted forms be returned within a_week in self-addressed,, 
stamped envelopes which were enclosed with the questionnaires. Two weeks 
following the return deadline, non-respondents were mailed follow-up post 
cards requesting that. they complete and return. their instrument. Of the ^ 
sample population, 65 percent (71 of 110) returned their questionnaires 
but four. instruments were not complete and, thus, not usable. Therefore, 

. the respondent popu-lation data used in this study represents 61 percent^ . 
of the sample population (67 of 110). 

Data Analysis ' " 

The data generated by the pilot test were examined and analyzed with 
regard to the validity of the inservice needs assessment instrument. The" 
•remainder of this chapter is divided into sections which, examine the 
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content, face, construct, and utility validity of the instrument. 

Content" validity . Content validity is a measure -isf the extent to which an 
instrument's items represent the content that the .instrument is designed to 
measure (Borg & Gall , 1979, p. 212). Thi.<- study's inservice needs assess- 
ment instrument contains items designed to measure respondent's inseryice 
needs which correspond to the set of knowledge and skil 1 s required for 
success in each cell in the Competency Matrix (see Figure 1). Therefore, 
the instrument is believed to reflect the universe selected for measurement: 
all areas represented by the Competency Matrix. That Matrix contains the 
12 domains of knowledge and skills involved when serving special needs 
learners. 

Since the Competency Matrix was developed after considering the content 
of competency studies drawn from the literature, the .face and. content 
validity associated with those previous studies were also supportive of the 
Competency Matrix. The Matrix categorized educator competencies into do- 
mains. The- Conceptual Framework (see Figure 3) related those domains to 
general education models. Thus, the Conceptual Framework further estab- 
lishes the basis for- the content validity of'the Matrix. The Matrix and 
Conceptual Framework define the universe of skills and knowledge into 12 
domains which are considered essential when effectively serving special 
needs students. By using these 12 domains as the bases for developing items 
for the instrument, the instrument's content validity was established. 

In addition, drafts of this instrumentj^erg^reviewed by other re- 
searchers, teachers, project advisory committee members, and vocational 
teacher educators, who verified that the instrument did represent the 
Conceptual Framework and the competencies represented by that Framework. 
Therefore, the content validity of- this instrument seems to have been 
adequately_establ ished at this point. 

Face validity . The Comments Page was attached to each pilot test instru- 
ment (see Appendix B) in order to obtain each respondent's reaction to the 
. following aspects 'of the instrument: (a) appropriateness as an inservice 
needs assessment' device,, (b) level of reading difficulty, (c) physical 
layout and size, (d) length, (e) competency domairis selected, and (f) 
clarity of instructions. The instrument's face validity, a subjective 



judgment that the instrument _appears to cover relevant content (Borg & 
GalU 1979, p. .212) was high among most respondents, especially those with 
special needs-related job titles. However, among some of the respondents 
who had little or no prior'' contact with special needs learners there were 
numerous comments which indicated that the instrument was too complex in 
format, used too many technical terms, and not necessary for persons who do 
not serve special ■needs^Tearners . " Although persons in this group represented 
fewer than 2.0% of the respondents, their concerns must be considered when 
the instrument is revised. ' . ' • ' . • . 

\- It was conclusjed, therefore, that most respondents' comments, indi^cated 
that they believed the instrument' could measure inservice needs and that the 
instrument had moderate to; high levels of face validity. However, in order 
to gain higher face validity with a broader range of respondents, the in- 
structions, . item content, and format of the instrument will need to be 
simplified, reorganized, and the objectives made more obvious. 

Construct validity . Construct validity is defined as the extent to which 
an instrument can be shown to measure a hypothetical construct (Borg" & 
Gall', 1979, p.. 216rand the Instrument's ability to produce results consis- 
tent with a particular theory or concept (Nunally, 1978, p. 85). Construct 
validity, therefore, would suggest that the instrument is generating data 
from th¥ respondent population that are consistent with general theories 
about the characteristics of specific groups of educators and their types 
of training needs. Theories which would enable educational planners to 
hypothesize about the extent and nature of special needs-related inservice 
needs do not currently exist. Theories about educators' characteristics 
and theif training needs corresponding to competency ratings in the do- 
mains and phases of the Matrix must be developed and validated. The Matrix 
and related theories, once adequately validated, can be used as a standard 
with which the construct validity of special needs-related inservice needs, 
assessment processes caji be examined. " In the absence of these theories, _ 
hypotheses were developed for this project that were based upon general 
assumptions often made about educators' biographical characteristics and 
levels of skills and knowledge. This grossly investigated the idea of. 
construct validity in this pilot test analysis. The hypotheses were, 
based upon the assumption that educators' training needs vary in relation- 
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to .the -foil owing: (a) irjespondents ' job categories, (b) respondents 'Xlevels 
of educational preparation, (c) the number of special needs students se^v.ed 
by respondents, and«(-:d) efnploVment at the secondary or postsecpndary level X 

It was acknowledged beforehand that these biographical measures have 
not been found to be highly correlated with sel f-perceived' needs in pre- 
vious competency studies with vocational education teachers (Geigle,''1978) . 
Th'eref 0 re\'"onl iT ITmTte d expectations existed r'e'gairdi rig the feasibility of • 
establishing construct validity using biographi cal" measures-. In spite of 
these limitations, the attempt was made to use biographical measures to 
establish construct validity as a means, to begin the validation process 
since this procedure represented the 'only"avai1 abl e. approach far examining, 
the instrument's construct validity. It was realized, however that much, 
more work will remain to be accomplished in future inquiries of this type. 
The logic. of examining construct validity in the above context was to hypo- 
thesi-^ze that if the respondent self-ratings effectively measure the inservice 
needs of vocational educators and possess an acceptable level of construct 
validity, this might be indicated by differences /(p <40) in the mean 
.self-ratings of training needs. / 

Job categories might be expected to be sensitive indicators of inservice 
needs. Persons associated with support services and work, experience program 
coordinator roles are normally in contact with special needs students and 
a.re''also required to have extensive professional preparatory experiences . 
(e.g., coursework, internships) prior to being certified to serve special 
needs students. .Persons in these job categories and those in the teacher, 
administrator, and other job categories have generally had differing prior 
educational program experiences. Thus ,.' inservice needs could be expected 
to differ for persons in the various job categories. 

Educational preparation, as normally, indicated by the level of educa- ^ 
tion attained, was selected as a characteristic likely to be associated 
with self-ratings of inservice needs. Educators with more education were 
expected to have been exposed to more extensive educational experiences in 
regard to serving the educational needs of divergent types of learners. 
Therefore, respondents with more education might express different self- 
ratings of inservice needs. 

Respondents who bave served special needs students were expected to 
have learned more about the educational needs of such . students than have 



those respondents who have not had such experiences. Therefore, persons 
who have not interacted extensively with special needs learners were ex- 
pected to indicate different inservice need levels than' persons with ex- 
tensive contact with special needs learners. " . 

There is a tendency among Minnesota AVTI' s to hire a majority of staff 
mfembers with extensive work experience within their fields of specialization. 
However, many of these s'taff members do not hold college degrees. At the 
secondary level , with the exception of some secondary vocational centers, . 
instructors must hold appropriate degrees in order to be certified to teach.- 
Since, until recently, there has been no mandate 'or major policy commit- 
ments in many postsecondary vocational programs to serve special populations, 
those' populations' have been served predominantly at the secondary level. 
This tendency has limited the financial ar\d programmatic commitments of 
many vocational educators iii postsecondary programs to prepare themselves 
to effectively serve special needs learners. Therefore, respondents in 
the secondary schools could be expected to have previously experienced 
more extensiv.e, more appropriate educational preparation for serving special 
needs learners and to indicate different special needs-related inservice 
needs than' respondents in postsecondary institutions. ' ' 

An analysis of variance procedure (ANOVA) was used to.test differences t 
twee.n respondent's self-ratings of their need for special needs related in- 
service among: (a) job categories, (b) type of educational preparation, 
(c) the number of special needs students served; and (d) persons in secon- 
dary and postsecondary programs. Differences in means were tested at the ■ 
;iO level, of significance (p<_.10).^ 

The following formal hypotheses were established to assess the instru- 
inent's initial construct validity for educators' self-ratings of inservice 
Ineeds : \ . , . 

\ 1. Educators' self-ratings o_f fnservice needs reflect differences 
I hPtw^Pn re<;pnndents' job categVies : (a) administrator, 

^ (b) teacher, (c) work experience'>rogram coordinator, and 

(d) support service personnel as measured by mean scores. 
2. Educators' self-ratings of inservice needs reflect differences 
between the respondents' typp of educational preparation: (a) 
less than . a bachelor's degree, (b) bachelor^ degree,, (c) 
master's degree, (d) special ist degree, (e) doctoral degree. 



■■ (f) journeyman, (g) technical specialist, and (h) bachelor's 
equivalent, a's measured by mean scores. 

3. Educators' self-ratings of inservice needs reflect differences- 
between the respondents' number of special needs students served . 

4. Educators' self-ratings of inservice needs reflect differences 

. 0 between the respondenfs' place of employment : (a) secondary- 

^ ■ ■ •> "• 

level programs and (b) postsecondary-level programs. 

Tables 2 through 5 present ANOVA generated ? ratio values which indi- 
cate the extent of the relationships between respondents' inservice needs 
ratings arid selected characteristics of the respondent population. Each of 
these tables contains a column on the left which identifies each, of the 12 
domains specified earlier in Figure 1 of this report. The four phases of 
each domain are represented by the four columns to the right of the domain 
column. The data' presented are F values based on the mean inservice need 
ratings within the competency areas. The F values correspond to the phases 
listed at the top of the table and the domains noted at the left of the 
table. Those F values with a level of significance equal to or less than 
10% .10) were judged to support the hypothesis in question. Such 

findings would support the initial , grossly conceived notion of construct 
validity of the instrument. The .10 level was selected because this was , 
a pilot test of the instrument rather than , an effort to collect descriptive 
inservice needs data where the .05 criterion level would normally be ac- 
cepted as the standard among educational "researchers . ^ 

With only five F ratio values in Tabl e 2. having a "p" value less than 
or equal to .10, the hypothesis that job categories are related to mean 
inservice ratings is clearly not generally supported. These data, there- 
fore, are not supportive of the instrument's construct validity, at least 
.using the measures employed .in this analysis.. . .. 

Table 3 presents the ANOVA analysis of the relationships between 
respondents' level ofprior education and their inservice need ratings. 
Of the 48 F values in this table, only six meet the p <_.10 criterion. 
Clearly these data do not strongly support the hypotiiesis that respondents 
with different levels of educational preparation have significantly dif- 
ferent inservice needs. 

Table 4 contains the ANOVA produced F ratio values which, when p ^'.10, 
suppbrt the hypothesis that respondents who have served large numbers of 
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" •\- ■ Table 2 . 
F Ratio Values for^Cqmparison of Inservice Needs Ratings 
of Educators ifr Different Job Categories 



Phase 



Domain^ 


Assessment 


r 1 aiim ng 


1 


•51 


1 R 


o 

d 


. '+0 




i 


?n 

. ou. 


20 


4 . 


1.26 


1.91 


5 


.54 


.86. 


6 


.79 


1.25 


7 


1.24 


.40 


8 


.82 


, 1.81 


9 


1.04 


1.13 


10 


1.12 


.36 


11 


1.16 . 


.69 


12 


**3.62 


1.81 



Implementation Evaluation 



.66 1.18 

.1.76 **2.71 
.07 - ■ . .17 

1.54 . 1.32 

.76 1.42 

.55 1.11 

.84 ■ 1.70 

1.12c 1.83 

1.44 .79 

.34 .97 

.93 .67 

*2.56 **3.17 



* p < .10 
** p < .05 

aoomains 1 through 12 correspond to the domain headings shown in Figure 1 

Table 3 

F Ratio Values for Comparison of Inservice Needs Ratings of 
Educators with Differing Educational Preparation 



Phase 



Domain 



Assessment Planning ' Implementation I Evaluation 



r 1 77 57 -59 .59 

Q 1 63 .95 .42' .98 

4 ■ lT3- -2.60 1.50 - *2..04 

6 - *2:09 . ''.98 .1:43 i:58 

7 • 1.74 ■ 1.42 1.37 1.18 



8 ' " .34 CO 

9- - . 1.37 - 1.04 'l^, 

I > „ m 1 19 -94 1.12 



39 .42 .40 



in " Q7 1 12 .94 

1? . ■ 1I4 ".24 1.38 : 1.73 

12 1 98 *'2.30 1.62 -3.70 

* P < 

** p. -< .05 ' , • 
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. • ' Table 4 ' ' ^ cr ■ , 

F Ratio Values for Comparison of* Inservi.ce Needs Ratings'of Educators 
Serving Differing Numbers of Special Needs Students 

Phase r 

: ^ cf . 

Domain Assessment Planning . ,Impl ementation Evaluation 



1 .25 • ^ -.57 - 1.15 1.35 

2 .90 ' 1.47 **3.'€P , ' .81 

3 -.98. --2.00^ '.88 4.19 

4 .25 '. ' 132 . .34 .20 

5 ' -86 .. .9,6 .79 1.25 

6 1.6'4 ' .07 .19 ■ .36 
7. 1.38 ,72 ■ .28 ^ 1.77 

8 .61 • ' .90 .92 ' ^ 1.12 

9 1.14 1.38 - .58 . ,87' 

10 1.92 *2.34 • 1.13 2.00 

11 .84 . ■ 1.25 ^ 1.40 1.17 

12 .29 - >.51 ' ,64 1.50 



* p <.10 
** p < .05 



special needs students have significantly di fferent .sel f-rated inserviCe " 
needs -as -compared to respondents who have served smaller numbers of special 
needs students. Only two of the F ratio values in Tabl^ 4 meet the cri- 
terion of p < .10, thus fail ing, to . support the hypothesis that respondents 
who have served large numbers of special needs students have significantly ..; 
different self-rated inservice needs than respondents who have served 
smal'ler numbers of special needs students. These data have al so failed- 
to provide support for the instrument's construct validity. 

'Table 5 contains the ANOVA produced F ratio values which, wh"err~p <vlO, 
support the hypothesis that' respondent's employed in ^secondary-level pro- 
grams have self-rated inservice needs which are significantly different 
from the inservice needs of respondents employed in postsecondary-1 evel pro 

> 

grams. The F ratio data contained in Table 5 do not support the hypothesis 
and this failure'to support the hypothesis also fails to substantiate the 



Tab! e"^5 



F Ratio Values for. Comparison p.f Inservice Needs^' Ratings of 
Educators at the Secondary and Postsecondary Levels ' 



Phase 



Domain 


Assessment 


Planning 


Implementation 


Evaluation 




2 21 


.03 


.74 


.20. 


9 


46 


1 72 


.71 


.OOl" . 


o 


01 


.14 


.003 


' .05 . 


d 


15 


.30 


.03 


o .01 ' = 


c 


.002 


.87 


.08 • 


.25 " • 


6 • 


.03 


.001 


,12 


.56 


7 


. ••- .06 


1.76 


.35 


nni 

. UUi 


8 


. t;8 


1.32 


.87 


•94 




.30- 


. .71 


1.32 


.24 


10 


.62 - 


.04 


.02 


.37 


11 


.00 


.07 


-.02; 


.04 


12 


1.28 


.12 ' 


1.08 


.45 



* p < ..10 

'*^'p-<_.05 



construct validity of the instrument. : 

In an. attempt to determine if the instrument was functioning, but at 
a low sensitivity level, an effort to identify additional indications of 
construct validity was conducted by examining another characteristic of the 
respondent population. This "analysis was based upon the hypothesis that • 
respondent groups (e.g., work experience program- coordinators) ^known to be 
homogeneous in terms of their. job duties should also 'tend to rate their 
inservice needs differently than the remaining portion of the respondent , 
population. This differencevwould hkve been, apparent when the standard 
deviations of ratings among'Th"e7two-;groups..w^re jxa 

.This effort to examine construct validity was conducted by analyzing 
mean inservice needs ratings in eacf} competency domain and by examining the 
consistency of those responses within a subgroup of -respondents . That 
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subgroup of respondents";' work experience program coordinator^ , was assumed, 
to be homogeneous in terms of the similarity of their job duties. If 
members of that subgroup were to respond in a similar manner, the standard 
deviations of ratings .within the subgroup- shouU be lower than thos,e in the 
more heterogeneous total group. Such a tendency would provide evidence' 
^hich would support the hypothesis that the instrument is sensitive to more 
refined'^measures of job catego.nzatron. 

• Tabid 6..di.splays the mean and standard' deviation scores for the homo- 
•geneous'job group: work experience program cooYdinators . Also included are 
"non-homogeneous job groups: (^) all respondents except the work experience, 
progre^m coordinators and (b) the combined total respondent, population. The 
data in Table 6 i^idicate that 10 of 12 (83°/^) of the standard deviation 
scores of the average domain inservice need self-ratings were lower among 
respondents' within the homogeneous job group than for the non-homogeneous 
groups and the standard deviations in the two remaining domains were equal 
in both groups. V -Thus, in this special analysis, the construct validity of 
the instrument seemed to have been supported but more evidence was sought. 

In order to verify that the differences in these scores are statisti- 
cally significant, a' two tailed t-test was applied. Table 7 shows the 
results of the analysis of differences between the most divergent groups: 
work experience coordinators versus all other members of the respondent 
population. The analysis indicates that only three of the differences 
found in the domain score comparisons were great enough to exceed the 
criterion level of p < .10. Therei;ore, these differences cannot be claimed 
as strong evidence of the instrument's construct validity. 

No conclusive evidence has been generated by this form of analysis 
that could support ji, conclusion that the instrument has construct validity. 
These findings can be interpreted as follows: (a) the instrument, in its 
current form, does not have adequate construct validity, (b) the biographi- 
cal ly based hypotheses could not effectively assess construct validity, 
(c) the instrument is not sensitive enought to. analyze the constructs in . 
question-, (d) the respondent population may typically have had little or 
no special needs-related inservice or preservice training and, thus, had 
no discernable differences in their inservice needs; and/or (e) some 
respondents- may have lacked sufficient motivation to provide accurate self- 
ratings of their special needs-related inservice needs. 



Table 6 

Numbers, Means, and Standard Deviations Within 
Homogeneous and Non-Homogeneous Oob Groups 





Work 


experience 




- 








program 






Total 




Average ' 

domain^ 
^ • ^a 


coordi nator 


AT 1 


U Lf Ic I o 


arouD ^ 














Mean 


Standard 


Mean 


Standard 


Mean 


Standard 


rating 


(N=22) 


deviations 


(N=44) 


deviations 


(N=67) 


deviations 


Domain 1 


2.6 


.9 


2.7 


1.2 


2.6 


1.1 


average 














Domain "2 


2.3 


1.2 


2.8 


1.2 


2.6 


1.2 


average 














Domain 3 


2.5 


.1.2 


2.5 


1.4 


2.5 


1.3 


average 














Domain 4 


1.5 


. 1.0 


2.0 


. 1.3 


1.8 


1.2 


average 








• • 






Domain 5 


3.1 


1-4 


2.8 


1.8 


2.9 


1.6 


average ■ 














Domain 6 


2.1 


1-4 


2.7 


1.4 


2.4 


1.4 


average 














Domain 7 


2.2 


1.3 


2.8 


1.5 


2.6 


1.5 


average 














Domain 8 


2.0 


1.3 


2.1 


1.7 


2.1 


1.6 


average 














Domain 9 


2.9 


1.4 


2.2 


1.6 


2.5 


1.6 . 


average 














Domain 10 


2.3 


1.3 


2.6 


1.5 


■ 2.5 


1.4 


average 














Domain 11 


2.6 


1.5 


2.8 


1.7 


2.8 


1.6 


average 














"Domain 12 


2.4 


1.3 


3.2 /r^. .1.4 


2.9 




average 















^Average inservice need ratings (j^) within each domain were calculated by 
adding the ratings for each of the four phases and dividing that sum by 
four (e.g., : = Al 4- A2 4- A3> M ) , 

\ 4 ^ 

bone respondent did not identify their job title. Therefore the total 
"'group is larger (N o;."; than the sum of the two subgroups (N = 66). 
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Table 7 - 

Relationships Between Inservice Needs Ratings Among Work 
Experience Coordinators and All Other Respondents^ 



Do ma 1 n 


Two-tailed t probability level 




.84 


,2 . ■ 


• 14 


.. 3 


.92 . 


4 


*.097 


5 


.54 


6 


.11 


7 


1 1 
.11 


* 8 




9 


*.086 


10 




11 ' 


.61 


12 


**.027 



*p < .10 
**p < .05 

aWorrexperience program coordinators (N=22) , other respondents (N=44). 



Utility validity . By determining the utility validity of an instrument, it 
is possible to establish the usefulness of the instrument in terms of the 
costs and benefits of the information generated by the instrument (BVpwn, 
1976,. p. 112). The utility derived from the pilot testing of this instru- 
ment was the economical generation of useful descriptive information that 
could aid planners in their attempts to better understand the inservice 
needs of persons within, selected populations and to plan inservice acti- 
vities to meet those needs. 

The inservice needs assessment instrument's utility value is also 
demonstrated by the respondent rating frequency figures (see Appendix C 
for all 12 frequency charts) which show respondents' inservice needs 
levels in each of the 1,2 domains. Figure 5 and 6 are displayed as 
examples of those frequency figures to show how self-ratings of inservice 
needs from Part II of the instrument can be aggregated and graphically de- 
picted. The frequency .profiles produced by the aggregated responses at 



Key . 
Aaseaament 
Planning 

Implementation ^ 
Evaluation *^ 




No need Low Moderate ■ High 

Figure 5. The Classroom Physical Environment: Levels of Need for Training 
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Key 

Aaseflsnient ***** 
.Planning 

Implementation ■ 

Evaluation " — 




U 

No need 



I 

Low 



Moderate . High 

Figure 6. The Individualized Education Plan: Levels o"f Need for Training 
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each level of need provide useful information to inservice planners^ 

Figure 5, which display inservice needs related to* the Class/Toom 
Physical Environment Domain, gives, a clear indication that many of the 
respondents feel they have "no need'' (approximately 18%) or "low need" 
(approximately 25%) for inservice focused on how to effectively alter or 
adjust the classroom physical environment in order to accommodate special 
needs students/ It also seems apparent that respondents view their 
needs* in the assessment phase differently than their needs in the other* 
three phases. Persons analyzing the implications of Figure 5 can readily 
surmise that only a small proportion of the respondent population feel 
moderate to high levels of need for inservice in the planning-, impl ementa-. 
tion, and evaluation phases of this competency domain. However, a larger 
group did indicate moderate or moderate-high needs for inservice focused on 
the assessment of the classroom physical environment. 

' ■ The frequency profiles contained in Figure 6 are very different from 
those contained in the previous figure. It seems apparent that the 
respondents' ratings of their inservice needs in all four phases of the 
Individual 1 zed Education Plan domain are similar. Although approximately 
30% of the respondents indicated "no" or "low" inservice need levels in 
this domain,- 70% indicated "moderate" to "high" need levels. Obviously, 
these figures indicate that subgroups exist within the population with 
differing perceptions of their inservice needs in these two competency 
domains. - 

The usefulness of the aggregated inservice needs data displayed in 
frequency figures is readily apparent. Planners^ of inservice can examine 
these displays . and note: (a) homogeneity vs. heterogeneity of population 
needs, (b) similarities or differences in inservice needs among the four 
phases within each domain, and (c) differences and similarities of 
inj^ervice needs in one competency domain when compared with those in other 
domains. From these'types of . information it is possible to make planning 
decisions and establish priorities than can enhance and guide final 
inservice planning efforts. These frequency data may also identify areas 
where major and/or unexpected areas of inservice need exist, thus setting 
ciirections for additional investigations and analysis. 

Part III of the instrument polled respondents regarding their "How, 
When, and By Whom" inservice delivery preferences (see Table 8). When ^ 
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Inservice 



Table 8 

Delivery Preferences 



Form of inservice 




First choices^ 




. (N=67) 


. How 


Workshops 




34.3%, 


Individual help from "experts" . 




19.4% 


Observing exemplary teachers and successful 


programs 


13.4% 


Higher education courses 




. ■ 10.4% 


Individualized training modules, workbooks. 


films, etc. 


7.5% • 


. . When 


Professional days during school hours, 




77.6% 


After school: Vate afternoons 




9.0% 


Summer: weekdays 




7.5% 


After school : eveni ngs 




4.5% 


; By Whom 

-1 , — — ■ " 



Other expert teachers 25.4% 

University experts from both vocational education and special 22.4% 

education departments 

Nationally recognized vocational special needs experts 19.4% 

Vocational special needs experts from university departments 17.9% 

of vocational education. 



^Percentage values indicate the number of respondents who indicated . that " 
ticular form of inservice was their first choice among the ojjtions. 



a 



divided by' 67 (the number of respondents). 
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asked how inservice activities should be delivered, respondents indicated 
strong preference (34.3%) for the Workshop format.. However, substantial " 
numbers of respondents also chose each of the following delivery options: 
(a) ind ividu al help from experts (19.4°^), (b)' observing exemplary teachers 
and exemplary programs (13.4%), and (c) higher education courses (10.4%). 

When asked when inservice activities should be provided, respondents 
overwhelmingly (77.6%) selected professional days as the most desirable time 
to participate. Finally, when respondents were asked who they most preferred 
as providers of inservice activities, their choices were somewhat equally 
distributed among four options: (a) other expert teachers .(25.4%), (b) 
university experts from both vocational education and special education 
departments (22.4%), (c) nationally recognized vocational special needs 
experts (19.4%),- and (d) vocational special needs experts from university, 
departments of vocational education (17.9%). 

The pilot test Vesults from Part III of the instrument have provided 
definite indications that preferences for specific forms and time for in- 
service activities exist among the respondents. There is also evidence 
that a variety of inservice deliverers will be acceptable to many respon- 
dents. Thfe- feasibility of generating, information, the potential usefulness 
of information created by using this instrument, and the limited amounts of 
time, effort, and funds required for this process have, thus, substantiated . 
\he instrument's high level of utility validity. 

. In order to evaluate the usefulness of assessing respondents' inservice 
needs in each of the four phases of each competency domain , respondents' 
ratings of their inservice needs in each of the four phases within each 
of the 12 domains were correlated. Tab-le 9 displ ays 'those correlation 
values vertically in relation to the phases listed at the top of the table 
and horizontally from the domains noted at the left of the table. Approxi- 
mately 92% of the correlation values exceeded .60. It is. also important 
to note that correlation levels between inservice needs ratings in the 
four phases in dissimil ar domains were much lower, typically between .10 
and .40. These data indicate a definite tendency among respondents to 
rate their inservice needs similarly in the phases within a gi.yen domain, 
while their ratings in the phases of different domains tended to vary 
much more extensively. T^ese data also provide supportive evidence that ' 
\he. instrument- is sensitive to differing levels of inservi,ce needs among 
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table 9 





Correlations Between the ^Phases 


wi tni n 




Dnma i n 

1 


Domain 


Phase Assessment Planning 


Implementation 


Evaluation 


1 


Assessment 


1 no 










rianmng 




1 00 








Imp! ementation 


1 Q 


68* 


1.00 






Eval uation 


.13 


.52* 


.63* 


1.00 


o 

c . 


Assessment 


1 nn 










Planning 


76* 


1 .00 








Imp! ementation 




Rn* 


1.00 






Evaluation 


.48* 


.67* 


.74* 


1.00 


o 


Assessment 


1 no 






■ 




PI anning 




1 00 








Imp! ementation • 


fin* 


86* 


. 1.00 






. Eval uation 


.70* 


.82* 


.83* 


1.00 


A 


Assessment 


1 nn 




•- 






Planning 


• / o 


1 00 








Implementation 




8Q* 


1.00 






Evaluation 


.63* 


.77* 


.83* 


l.OC 


c 
D 


Assessment 


1 nn 










Planning 


RR* 


1 00 




- 




Impl ementation 


• . OD 


01 * 
• -/l ^ 


1.00 






Evaluation 




. O/ 


.90* 


1.00 


p 


Assessment 


''1.00 










PI anning 


.64* 


1.00 








Implementation 


.76 


.89* 


1.00 






Evaluation 


. .67* 


.85* 


.86* 


" 1 .00 



* p < .001 

Note: Correlations between inservice need ratings related to phases in 
different domains were typically at low levels (i.e., -.10 to .40). 



Table 9 (Continued) 
Correlations Between the Phases Within Each Competency Domain 



Domain 


Phase 


Assessment 


Planning 


Implementation 


Evaluation 


7 


Ac coccmpn^" 


1 no 










Pi ;i nni nn 


64* 


1 .00 








iinp 1 clllcil La L 1 Uil 




89* 


1 00 ' 






Evaluation 


.67* 


■■-.85* 


.86* 


1.00 


Q 
O 


Ac coc cmOrtl' 
r\b b c b ^lllci 1 u 


1 nn 










r 1 ct 1 II 1 1 ■ 


77 


1 00 








i llip 1 cUIci 1 L a L 1 U 1 1 


71*' 


90* 


1 00 


- - 




Evaluation 


.81* 


. .81* 


.81* 


1.00 


Q 




1 00 










Pi 3 n n inn 


81* 


1 • 00 




• 




Tm 1 Am a M ^" a ^" T f\T\ 

xnip 1 cmen ua u i uri 


7Q* 


96* 


1 00 






Evaluation 


.87* 


.95* 


.93* 

. ■ 


1 . 00 


iU 


MS Scb bihcil C 


1 nn 


it 








r 1 pnm iiy 


87* 


• 1.00 








iinp 1 enienxa ui on 


7A* 


92* 


1 .00 






Evaluation 


.84* 


.95* 


.92* 


1.00 


1 1 
1 1 


MS Scssnicii u 


1 nn 










Dl a nn "1 nn 
r 1 aili 1 1 iiy 


92* 


1.00 








iinp 1 ciiicn ua u I un 


Q1 * 


95* 


1 .00 






Evaluation 


. 91 * 


. 93* 


.91* 


1.00 


12 


Assessment 


1.00 










PI anning 


.87* 


1.00 








Impl ementation 


.80* 


. .91* 


1.00 






Evaluation 


. .83* 


.87* 


.QS* 


1.00 



* p < .0.01 

Note,: Correlations levels between inservice need ratings related to phases 
in different domains were- typical ly at low levels (i,e., -.10 to .40). 



Er|c . / . 46 - 50 



the various domains and that respondents' ratings wi.thin those domains are 
indicating that inservice needs do differ by domain. 



Limitations 

. i * 

The basic premise of t^s study is an assumption that the training' of ' 
educators to effectively serve special needs students will have a positive 
impact on the success levels of those students. The value of this research 
project and its findings are based upon the validity of this assumption. 

There is also potential bias in the survey generated pilot test data. 
Since only 61> of the sample population actually returned completed instru- 
ments., the selV-rated inservice needs of 39% of that population are not 
represented in the data base. Although all major types of secondary and 
postsecondary vocational programs were represented among the respondents' 
employing institutions, there currently is no assurance that the non-respon- 
ents are not divergent in their- inservice needs and would have significantly 
changed the resulting data analyses. 

The limited sample population of 110. persons was comprised entirely of 
persons employed as vocational educators in Minnesota. Not only would it 
currentlvy be inappropriate to attempt to make gross generalizations beyond 
the Minnesota institutions involved, but implications must also be currently 
limited onlV to vocational educators: Additional investigations must begin 
to substantiate or refute similarities of inservice needs among vocational, 
general, and special educators in a variety of types of institutions and at 

differing locations. 

It was also ve^y difficult to establish substantive indications o.f 
construct validity i>i a realm for which no other direct measures exist. 
.No other special needs^rrel ated vocational inservice needs assessment in- 
struments with established reliability and validity currently exist for 
comparison purposes, Thebries about the special needs inservice training 
requirements of vocational \ducators and the Conceptual Framework must be 
developed and validated. Data must then be collected specific to those 
theories in order to establishXthe construct validity of the instrument(s) ' 
used to collect the data.- The construct validity of the pilot test instru- 
ment in this study /had to be examined indirectly by means of comparing . in- 
service need ratings derived from groups of respondents hypothesized to 
have divergent inservice needs. \ 
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Chapter IV 



CONCLUSIONS AND RECOMMENDATIONS 

This study has proposed that:, (a) special^ needs-related educator 
competenc,ies can be identified and classified into domains through a special 
needs conceptual framework and matrix, (b) an instrument can be developed • 
that provides valid and rel iabl e. assessments of educator's needs for 
training in the various competency domains, (c) a pilot test of that instru- ' 
ment can establish the instrument's present levels of validity,, and (d) an 
analysis, of the pilot test results can provide ^guidance as to how the - 
instrument should be revised..- After conducting a thorough review and 
synthesis of the current literature, a needs assessment instrument was 
developed and pilot tested. 

Discussion and Conclusions 

As stated in the introduction to this report, there are many studies 
-currently being conducted to identify special needs-related educator 
competend,ies , develop and conduct educator training needs assessments, and 
provide training activities to facilitate the mainstreaming of special needs 
students Tnto regular vocational programs. This study has attempted to go 
beycnd the research efforts reported in the review, of literature. This was^ 
accomplished" through the development of_a conceptual framework that enhanced 
the'construct and corvteoi val idity for the Matrix domains utilized by the 
needs assessment instrument to assess educators' training heeds and the 
analysis of pilot test data to examine the validity of information collected 
with the instrument. / " . i 

Part I of the needs assessment^ instrument was used to generate 
evidence of whether or not respondents' self-ratings of their inservice 
needs varied in relation to their biographical characteristics in a statis- 
tically meaningful manner.. No strong evidence was found that woul d support 
claims that responses varied in accordance with any of the biographically • 
based hypotheses. The open-ended response items in Part I would klso have 
been easier to analyze if ^specific answers had been provided for selection 
by respondents instead of allowing them to generate their own answers which 
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varied widely among respondents and were often difficult to categorize. 

Part II„of "the instrument focused on educators' self-ratings of 
inservice needs and was designed to identify areas of educational competen- 
cies which should be exanvined in order to assist educational planners to 
select, and develop specific special needs-related inservice activities. The 
■^anaV^ses- of .data- -generated by- Parts" I and.il of the instrument did not 
irfdieate that. the' .instriiiment'had high levels of construct validity. However, 
dueV-to the comple_kity , of "the .variables which were interacting when the 
"instrument was pilot tested, ii-is possible that inadequate hypotheses were 
selected to examine construct validity and, thus, may have produced 
misleading results. 

The frequency charts, which/depicted the number of persons selecting 
each inservice need level in the four phases of each domain, indicated that 
membe,r.s of the respondent population had vastly differing needs. This may 
mean that responden-ts were actually very different in their Inservice needs 
' arid/or^ it ^ay reflect' respondents ' differing motivation level s and attitudes 
related to whether or not , it is appropriate to serve mainstreamed students 
in. vocational' education programs.' The influence'of such attitudes would. . 
have greatly distorted. the results produced by the instrument. However, all 
of this information is useful and must be considered by persons planning 
inservice training' activities . 

■ The instrume^'H^utility validity was clearly established by the manner 
. in which frequency charts,- produced fV-om'the- aggregated responses for each 
level of inservice ne'ed in all phases of each of the 12 domains, can be 
utilized to analyze respondents' inservice needs. These frequency charts 
give clear visual indications of areas which inservice planners may choose 
to investigate further in, order to desi gn useful, effective inservice 
activities . \ 

: - The instrument' s- content val idity was assured in Part II by utlizing 
items, for rating inservice need levels, which correspond to- each of the 48 
cells in the Competency Matrix. Since the Competency Matrix was designed 
to represent all special needs-related educational competencies, dr^iwn from^ 
the literature^, the instrument was felt to reflect the universe selected 
for measurement.' 

A correlational study of the ratings within domains and across domains 
indicated that the four phase-related responses in each domain are very 
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similar. However, the ratings by phase in different domains tended^ to be 
somewhat different. Therefore, after the next revision and testing of the 
instrument,, there may be no need for four inservice needs ratings in each 
domain, one rating per domain may be sufficient for the final version of . 
the instrument. 

, Part III of the instrument examined respondents' preferences, related to 
"How-When-By Whom".' inservice activities should be delivered. Although as 
many as 11 choices were provided, only \four ,or five were selected by. 
substantial numbers Oif respondents.- Therefore, those unused or seldom used 
choices should be deleted from' future versions of the instrument. 

The Comments Page, attached. to the back of the instrument duffing pilot 
testing,- collected information about the organization and physical character 
istics of the instrument. The size and style in which the instrument., was 
produced were generally acceptable to respondents. However,! the amount of 
time required to read, interpret, and complete the instrument was often 
felt to be excessive. Many respondents indicated that the instructions and 
level of terminology were too complex to allow easy completion of. the 
instrument. Also, many comments seemed to indicate that the actual purpose 
of the instrument was misunderstood; some respondents thought the instrument 
was designed only for, use by educators who are currently providing servites 
di rectify to special needs populations. 

The Comments Page provided useful indications of the instrument's face 
validity. Respondents overwhelmingly, agreed, that the^ instrument was an 
appropriate approach to the assessment of their inservice needs. It was 
also esota.bli shed that the 12 domains seemed to thoroughly exhaust the 
possible areas of special needs-related educational competencies. 
'■."../■ • ■ . . 

'"^Recommendations 

This report has presented the conceptualization, design, and pilot 
test of. an instrument for use in the process=of assessing the inservice 
training needs of educators working with special needs students. The 
results of this' pi lot test have indicated that the process requires 
specific modifications in order to enhance the validity of data collected 
in the future. - 



The following recommendations are presented for consideration: 

1. The instruments' reading level and physical format should 
be-'simpl i fi ed. More concise conceptual definitions should 
also be developed for the. domains in order to make the 
instrument more easily understood. 

2. New approaches to studying the instrument's construct 
validity, through the use of the Competency Matrix and 
Conceptual Framewoi^k, should be studied and developed. 

E^ffdrts to examine the instrument's reliability and 

- I . .. . 

o-rher forms of validity should also be initiated. 

3. A revised dr^ft of the instrument should be used to • 

- collect inservice needs data from a population known to be . 
competent educators of vocational special needs students. 
Data should also be collected from educators who have had 
no special trainin.g related to special needs students and 
who have, had no educational experience with such persons. 
These data should be utilized to more thoroughly examine, 
the revised instrument's validity and reliability. 

4. After, the rev-ised instrument's validity and reliability 
have been more thoroughly examined based on "data from 
divergent competency groups, inservice needs ratings, 
should -be collected from a national sample of vocati'onal 
educators in order to expand the population with which the 
instrument can be utilized to collect meaningful inservice 
planning information. 

5. The \i^alue ofi:.rating inservice levels 1n all four phases 
of eath competency domain should be examined. If ratings 
vary according to each domain but are very similar (r > .80) 
within the phases of each domain, the phases should be 
deleted and only one rating obtained for each competency 
domain . 

6. Efforts should be focused on determining whether or not 
other existing and future special needs-related assessment 
processes have acceptable levels of validity and 
reliability. Until such characteristics have been 
demonstrated, educational planners cannot,, in good 
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conscience, use those processes to examine educators' 
inservice needs and to plan to accommodate the- professional 
development needs of those persons. 

The Competency Matrix and Conceptual Framework should be 
the object of additional research and development efforts. 
In particu\lar, it is recommended that the domains should be 
examined to\ determine if competence in a given domain is 
related to success when serving special needs learners. 
Also, the Framework's ability to delimit the areas related 
to educating vocational students with special educational, 
needs should be examined . by ^ a variety of approaches such 
as conferences, symposiums, workshops, and well designed 
research and development efforts. 
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1 



L BACKGROUND INFORMATION 

.A , ^ ' ' ' ' 

[Please Print] 

A. What is the title of your present position? , i , — . — : [ 

B. How many years have you been employed in your present position? _ ; 



C. ^How many total years have you been employed as an educator? 



D. What grade. level (s) do you currently ^serve [circle all that apply]? 
7 8 9 10 11 12 Post Secondary Other [Specify]: 



E. Which of the following best describes your educational preparation [select only one]? 

.. Less than a Bachelors Degreq^ Doctoral Degree 

Bachelor Degree Journeyman 

Masters Degree Technical Specialist 

Specialist Degree - Bachelor Equivalent 



F. In what field was your most recent degree granted? 



G. Are you currently vocationally certified? 

\ No * . 

Yes If yes; What type of certification do you now hold? 

• Regular f ^ • 

• ^ ^ Temporary 

Provisional 



H. Are you currently special education certified?; 

No ' ; 

Yes — If yes: In-which special education area(s) are you certified? 



I, Of which department are you a member? 

Vocational Education 

Special Education 



J. What is your estimate of the number of special needs students that you now typically serve 
in a sc^iool year? \ . 



^The phrase '^special needs studentB'^ refers to individuals with characteristics which prevent them from 
succeeding in vocational education proo^ame without additional or special asststancn. 
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//; INSERVICE NEEDS ASSESSMENT \ 

ABOUT THE INSTRUMENT: \ 

The twelve domains used in this instrument represent areas of competencies needed by educators inVder to^ 
serve vocational special needs students. These dbmairfe were identified following a thorough review^of prior 
competency related research, and the creation of a concfeptual model for identifying special needs, teacher com- 
petencies. Each domain is divided into four phases of performance or development. These phases are:\ 

ASSPSSMENT* The process of identifying and measuring those needs related to the students, staff, 

• * . community, curriculum, finance and facilities that exist within a domain. X 

PLANNING: process of outlining the procedures and steps for meeting selected needs within 

a domain. • 

IMPLEMENTATION: The process of .providing services and .activities to meet the selected needs within \ 
* a domafh. . ■ ' 

evaluation: The process of determining the adequacy, .qual ity and/or effect of the goals, objectives, 

inputs, procedures and outcomes within a domain. ^ \ ' 

The purpose of this instrument is to assess educators* training needs within each phase of the twelve domains, \ 
The instrument wiil also determine educators' inservice training delivery preferences. The results of this 
needs assessment will be used to plan future vocational special needs inservice activities and programs. 

DIRECTIONS: . ; ^ * - ' . . ^ ^ 

Below is a list of the twelve competency domains, including a brief definition of each domain title. After 
reading each of the definitions, please indicate the amount of additional training that YOU need in each domain 
phase to better serve your special needs students. CIRCLE one response for each domain phase. 

YOUR NEED FOR TRAINING 

EXAMPLE: NeL Low Moderate High 

DOMAIN: COURSE CURRICULUM Phase:, {ssesf^m^^ . . , ; ; ; ® j (|) 3 "1 5 

Implenenttftion * .1 2 3 , ® i 

. , " Evaluation; , * 1 2 3 4 (5) 

DOMAIN: EDUCATIONAL NEEDS OF THE STUDENT ^ ^^''"^ nS^^^ * i 2 3 1 j 

Those concel)ts and abilities which must be enhanced Implementation. • • • * \ \ \ \ \ 

or mastered by students in order to succeed within Evaluation 1 c s 

a given area of study. These needs may be of a 
cogniJ:ive. affective., and/or psychomotor nature. 

DOMAIN: PERSONAL NEEDS OF THE STUDENT Phase: Assessment * 1 2 3 .5 5 

Planning ' ^ J n 

Those interpersonal abilities and attitudes which. Implementation. . * . * 1 2 3 \ \ 

when developed and ^demonstrated by students, can Evaluation * 1 2 3 4 b 

enhance their sense of well-being and maximize 
their effective interaction with other people. 

DOMAIN: CLASSROOM SOCIAL ENVIRONMENT Phase: Assessment...... * ] ^ 3 4 5 

• P lanni ng 1 ^ ^ 

The development and maintenance of those attitudes Implementation .... * 1 2 \ \ \ 

and interactions between educators and students Evaluation 1 2 3 4 b 

which must exist in the learning environment to 
help alls^odents* achieve their educational , 
social, and emotional potential. 

DOMAIN^ CLASSROOM PHYSICAL ENVIRONMENT Phase: Assessment 1 2 3 4 5 

Planning ^ \ ^ ^ ^ 

Those physical characteristics of an educational Implementation . • • • * ] 9 i a q 

facility which affect access to and movement Evaluation ...... 1 2 3 a b 

through a building and the utilization of the 
various equipment, materials, and services 
within the building. 



OM/JIN: 



THE INDIVIDUALIZED EDUCATION 
PLAN (lEP) 



Phase: 



A Vntten plan which specifies processes, procedures, 
and instructional activities to be implemented by 
° loc^l education agencies, in order to insure that all 
iderftified special n^eds learners are provided ^^th 
"appVopriate" educational experiences within their 
"least restrictive environment". 

IOMIN: VCOURSE CURRICULUM 

* Those -goals, objectives, activities, and/or j 
' procedures that determine which topics will be 
presented, how,, when » and what achievement levels 
will be\ expected of students within a course. ' 



Assessment . * 
Planning . . . 
Implementation 
Evaluation . . 



Phase: 



)OMAIN: INSTRUCTIONAL MATERIALS 

The wide range of materials, commercial and 
• teacher made (e.g., books, handouts, A-V 
equipment,\ consummables, etc.), which xan be 
utilized during instructional activities in 
. order to focus cn and/or enhance. the effective- 
ness of the educational process. 

DOMAIN: SPECIAL NEEDS SUPPORT SERVICES 

Those specialists and supplemental educational 
personnel who are^a'vailable to enhance the 
educational experiences of students with sjpecial 
learning needs that cannot be sufficientjy ful- \ 
filled by a teacher alone in a regular classroom| 
setting- ^ 

DOMAIN: ' PAR:^NTS 

Those way: n which the parents and/or legal 
guardians oi special needs learners can best be , 
• utilized in t- der to enhance their child' s learm^ng 
experience (both at' school and^ at home and. actively 
participate in the- planning and delivofrssof those 
experiences with the child and his/her tetcherlsjL 

DOMAIN: COMMUNITY . . . | 

Those persons", agencies, and/or services at the 
local, state and national levels which can \ 
supplement and enhance the value and effectiveness 
of school experiences for students. 7 

DOMAIN; LEGISLATION AND FUNDING , | 

Those legal mandates that spaci fy: 1) which | 
persons are eligible for educational services 
beyond those typically provided to students in • 
regular classrooms; 2) who is responsible for the 
administration, funding, and delivery of these • , 
services; and 3) certain rights of educators, \ 
special needs learners and their parents. 

DOMAIN: CONTINUING PROFESSIONAL . 

DEVELOPMENT OF THE TEACHER 



Phase: 



Assessment . . 
Planning . . 
Implementation 
Evaluation . . 

Q r 

Assessment ; 
Planning . . . 
Implementation 
Evaluation ; , 



Phase: 



Phase: 



Phase: 



Phase: 



Phase: 
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procedures (formal and informal) by which 
ucator continues to seek to improve his/her 
ty to educate all students*.. 



Assessment . . 
Planning . . . 
Implementation 
Evaluation . . 



Assessment . • 
Planning . . 
Impl ementatlon 
Evaluation . . 



Assessment* — . 
Planning ... . 
Implementation 
Evaluation . . 

Assessment . .. 
Planning . . . 
Implementation 
Evaluation . . 



Assessment . .• 
Planning . . . 
Implementation 
Evaluation . . 



///. INSERVICE DELIVERY 

' . • ■ \ ■ 

\ 

A. How would you like to receive this inservice trajmng? 

(Read the entire list below. Select the three (3) that you prefer most , and rank them: 1 ' first choice.; 
2 = second choice; 3 = third choice) ^ \. . ' 

Higher Education Courses 

, Individualized Training Modules, Workbooks, Films, Etc. 

, ^ Workshops * . ^ 

^ Observing Exemplary Teachers and. Successfuli Programs ' ^• 

' _;internship Experiences ^ - ■ ' ^ ^ . ' . 

Attending Conventions and/or Professional Meetings * » . 

. Individual Help from 'lExperts" (Curriculum Writers, Counselors, Project Directors, 



Special Coordinators, Etc.) 



Other (specify): 



Conments: 



B. When would you like to eceive this inservice training? . ' 

(Select all acceptable choices-and rank them: .1 = first choipe; 7 = second choice; etc.) 



\ 



Weekends During the^ School Year 



\ "Professional" Days ^During School Hours 

' \ ■ , After School - Late Aft^ernoon 

i _v Aftef School - Evenings 

\_ Summer - Weekdays 

V Suimer - Weedends 



Sumner - Evenings 
Other (specify): 



Comments; 



Who would you like to provide and organize this inservice training? 

(Select ajj^ acceptable choices and rank them: 1 = first choice; 2 = second choice; etc.} 

^ Yourself 

. •■ Other Expert Teachers \ . 

• Other Staff From'the Local School District ^ 

Nationally Recognized Vocational Special Needs Experts 

^ Comnunity Agencies , 

Parent Groups 

Prbfessioqal Education Organizations (MEA> MVA, Etc.) , c 

Vocational Special Needs Experts from University Departments of Vocational Education 

Vocational Special Needs Experts from Bniversity Departments of Special Education 

University Experts from Both Vocational Education and Special Education Departments 

Vocational .Special Needs ^Experts from the Minnesota State Department of Education 

^ Other (specify): \ 

Comnents: \ 

, i ... ■; ' 

• ' ' - I ■ 

. Which would you prefer to receive for' participating in these inservice activities? 
College Credit / ' 

Licensure and/or Relicensure Clock Hour Credit 
Cornments: * \* ' ' 



1 



IV. COMMENTS 



Since this instrument is still in the development stage, we encourage you to answer^the. following questions and 
• JrovidryLrnalS and telephone number so that a member of the research project staff may contact you to discus 
your conrients. • Also, to, insure the confidentiality of your prior responses please detach.this sheet and return 
to us separately. . 



Name: 



Phone: [ ■ ) 



A^..,.Please explain whether you thought this was a good way to assess your inservice training needs for serving 
special needs students; 



B. Please list any conments or suggestions that might be useful in the improvement of the content and/or 
'construction of this questionnaire. 



1. The level of reading difficulty: 



2. *The physical layout and size of the questionnaire: 



3. The length of the questionnaire: 



4* The choice of competency domains: 



5. The clarity of instructions: 



6, Other: 
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APPENDIX C 

RESPONDENT RATING If REQUENCY CHARTS 
FOR THE TWELVE DOMAINS j 
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